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Abstract 

In this paper we derive the exact analytical expressions for the information and 
covariance matrices of the multivariate Burr and related distributions. These distribu- 
tions arise as tractable parametric models in reliability, actuarial science, economics, 
finance and telecommunications. We show that all the calculations can be obtained 
from one main moment multi dimensional integral whose expression is obtained through 
some particular change of variables. 
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1 Introduction 



In this paper the exact form of Fisher information matrix for multivariate Pareto (IV) and 
related distributions is determined. It is well-known that the information matrix is a valu- 
able tool for derivation of covariance matrix in the asymptotic distribution of maximum 
likelihood estimations (MLE). In the univariate case of the above distributions, the Fisher 
information matrix is found by Brazauskas [I]. As discussed in Serfling section^ un- 
der suitable regularity conditions, the determinant of the asymptotic covariance matrix of 
(MLE) reaches an optimal lower bound for the volume of the spread ellipsoid of joint estima- 
tors. In the univariate case of the Pareto (IV), this optimality property of (MLE) is widely 
used in the robustness versus efficiency studies as a quantitative benchmark for efficiency 
considerations (Brazauskas and Serfling [HIE], Brazauskas [3], Hampel et al 0, Huber |TUj . 
Klugman |14j . Kimber ^JJEl] and Lehmann |15j . Chapter 5). These distributions are suit- 
able for situations involving relatively high probability in the upper tails. More specifically, 
such models have been formulated in the context of actuarial science, reliability, economics, 
finance and teletrafic. These models arise whenever we need to infer the distributions of 
variables such as sizes of insurance claims, sizes of firms, income in a population of people, 
stock price fluctuations and length of telephone calls. For a broad discussion of Pareto mod- 
els and diverse applications see Arnold [2], Johnson, Kotz and Balakrishnan jllj . Chapter 
19. Gomes, Selman and Crato [S] have recently discovered Pareto (IV) tail behavior in the 
cost distributions of combinatorial search algorithms. 

This paper is organized as follows: Multivariate Pareto and Burr distribution are intro- 
duced and presented in section |21 Elements of the information and covariance matrix for 
multivariate Pareto (IV) distribution is derived in section |3J Elements of the information 
matrices for Multivariate Burr, Pareto (III), and Pareto (II) distributions are derived in 
section |3J Conclusion is presented in section |S| Derivation of first and second derivatives of 
the log density and the main moment integral calculation are given in Appendices A and B 
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2 Multivariate Pareto and Burr distributions 



As discussed in Arnold [2] Chapter 3, a hierarchy of Pareto distribution is established by 
starting with the classical Pareto (I) distribution and subsequently introducing additional 
parameters related to location, scale, shape and inequality (Gini index). Such an approach 
leads to a very general family of distributions, called the Pareto (IV) family, with the cumu- 
lative distribution function 

F x (s) = l-(l + (^)*) \ x>fa (1) 

where — oo < ji < +oo is the location parameter, 9 > is the scale parameter, 7 > is the 
inequality parameter and a > is the shape parameter which characterizes the tail of the 
distribution. We note this distribution by Pareto (IV) (/i, 9, 7, a). Parameter 7 is called the 
inequality parameter because of its interpretation in the economics context. That is, if we 
choose a = 1 and \i = in expression (fT)). the parameter (7 < 1) is precisely the Gini index 
of inequality. For the Pareto (IV) (fa 9,^/, a) distribution, we have the density function 

fx(x)= - { 9 ] +1 , x>fa (2) 
The density of the 72,-dimensional Pareto (IV) distribution is 

/ n \ -("+") n 

Mx)= 1+ b^>* n^(^)*- 1 . — (3) 

\ j=l J / i=l 

where x = [xi, ■ ■ ■ , x n ), Xi > fa, a > 0, 7, > 0, 9{ > for i = 1, • • • , n. One of the main 
properties of this distribution is that, the joint density of any subset of the components of a 
Pareto random vector is again of the form @ [2]- 

The n-dimensional Burr distribution has the density 

/»(*) = (1 + E(^) cj ) n {a+i g ~ 1) * (^) ei -\ *i > (4) 

where x^ > fa, a > 0, q > 0, 9^ > for i = 1, • • • , n. We note that the multivariate Burr 
distribution is equivalent to the multivariate Pareto distribution with — = q. 
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3 Information Matrix for Multivariate Pareto (IV) 

Suppose X is a random vector with the probability density function /e(-) where = 
6*2, 6 K ). The information matrix 1(0) is the K x K matrix with elements 

'd 2 lnf e (X) 



= -E 



dOidOi 



i,j = l,---K. 



(5) 



For the multivariate Pareto (IV), we have 9 = (//i, /j, n , 6i, 9 n , 71, 7„, a). In order 
to make the multivariate Pareto (IV) distribution a regular family (in terms of maximum 
likelihood estimation), we assume that /i is known and, without loss of generality, equal to 
0. In this case information matrix is (2n + 1) x (2n + 1). Thus, further treatment is based 
on the following multivariate density function 



/.<»>=(i+E(r'' 



The log-density is: 
ln/n(as) 



E 

i=i 



"( Q+n ) n • -, / \ --1 

j-j- a • ! / .r \ ■ 



^7i 



ft 



X,; > 0. 



(6) 



ln(a + i-l) -lnft+ ( 1 - 1^ In ^ 



In 7* 



-(a + n)ln(l + ^(^ V 



(7) 



Since the information matrix 1(6) is symmetric it is enough to find elements %(©), where 
l<i<j<2n+l. The required first and second partial derivatives of the above expression 
are given in the Appendix A. Looking at these expressions, we see that to determine the 
expression of the information matrix and score functions, we need to find the expressions of: 



and the general terms 



E 



1 no 



,«3 x 



, (ni, n 2 > -1) £ R, n 3 , n 4 G N + and n 5 G R H 



3.1 Main strategy to obtain expressions of the expectations 

Derivation of these expressions are based on the following strategy: first, we derive an 
analytical expression for the following integral 

" + 00 n / 



E 



n 

i=i 



6; 



i=l 



H(f ] i fn(x)dx, 



(8) 



and then, we show that all the other expressions can be found easily from it. We consider 
this derivation as one of the main contributions of this work. This derivation is given in the 
Appendix B. The result is the following: 

-+oo n 

9i 



E 



II 



i=l 



9; 



i=l 



IK? Yu*)** 



r(«-Er = in)nr = ir(r, + i) 

r(a) 

n 

< a, n> -l, n e R, 

1=1 



(9) 



where T is the usual Gamma function, 



~^ r i r k i ^ y ft 



i=i 



d 2 T (a - J2U Ti 



d n fT'(z) 



dz n \T(z 



z > 0, 



dr k dn 
dr^dr\ 



1 < L k < n, 



(^M^ (z), z>0 



and integers n, m > (Abramowitz and Stegun pQ). Specifically, we use digamma ^(z) = 
tri gamma ^'(z) and ^ nr)fe (z) functions. To confirm the regularity of ln/ n (£c) and 
evaluation the expected Fisher information matrix, we take expectations of first and second 
order partial derivatives of (J7J). All the other expressions can be derived from this main 
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result. Taking of derivative with respect to a, from the both sides of the relation 

f n (x) dx, 







leads to 



E 



n 

y — - — • 

^ a + % - 1 



From relation Q, for a pair of (/, k) we have 



Xl \ 11 ( X k \ Ik 



T(q - r f - r fe )r(r f + l)r(r fe + 1) 

r(a) 



and 



(p(ri = ni,r k = n 2 ) = E 



Xl \ ~<l ( Xu \ Tfc 



ft 



^ ^ In" 4 ^ In™ 3 ^ 



Xi 



X, 



ft 



From relation (|TT|) . at = we obtain 



E 



ft 



Ha - r,)r(r, + 1) 



r(ai 



and evaluating this expectation at ri — 1, we obtain 



E 



ft 



a — 1 



Writing the expression of the expectation 



E 



as E a to emphasis the role of the parameter a in (JHJ), it can easily be shown that 



E, 



a 



a + n 



E Q +i 



Xi\- 

ft 



6 



Using ()14|) with a replaced by a + 1, we now obtain an expression for the last expectation 
as 

j_ 

I x A n 

1 



E, 



a + n 



Differentiating (fT3|) with respect to ri, and replacing for r/ = and r/ = 1, we obtain the 
following relations: 



E 



In 



Xj, 

o, 



E 



and 



X t \*. (X x 



8i I 111 I e l 



7 z[r'(l)-^(a)], 

"r'(2)-*(a-l) 



i + E?=i 



7/ 



a 



a — 1 



(16) 
(17) 



a + n 



-E 



a+l 



18) 



3.2 Expectations of the score functions 

The expectations of the first three partial derivations of the first order follow immediately 
from the corresponding results for their three corresponding parameters and we obtain: 



E 



E 



d]nf n (X) 

da 



dhifn{X) 



n 

y — — 

^ a + i - 1 

i=i 



E 



Oili V. Oili 



3=1 V 3 



X, \ 7, 



0, 



n ( Xj \ 7 



0. 



E 



dhi/ w (X) 

^7; 



-I-1e 

H it 



In I ^ 



a + n 



E 



£P In ^ 



1 + 



n I X. \ 7 



0. 
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3.3 The expected Fisher information matrix 



Main strategy is again based d on the integral J0J) which is presented in the Appendix B. 
However, derivation of the following expressions can be obtained mecanically but after some 
tedious algebraic simplifications : 



2 ' 



Ix (11,01) 



i x (e h a) 

1 



Ix(0i) 



7/ (a + n) 

a + n — 1 
= 9fif (a + n + l) 



1 (a + i — 1) 
1 

Oai (a + n) ' 
[r'(2) - , l = l,---,n, 



Ix(li) 



a + n — 1 



7 2 (a + n + l) [r(a 
2(a + n-2) 



Z = n, 



+ r"(i) + i 



(19) 

(20) 
(21) 
(22) 



7 2 (a + n + 1) 
2(a + n- 1) 



7 2 (a + n + 1) 



[r'(i) - *(«)] 
f(l)*(a)], «=1, 



1 



OaHkdk (a + n+l) 



(23) 
(24) 



ixduik) 



-1 



7/7fc (a + n + l) 
Ix(B hlh ) = 



(r'(2)) 2 - r'(2) (* n (a) + * rfc (a)) + * nrfc (a))J , & ^ Z, (25) 
1 



/aj(e,,7i) 



a + n — 1 



Oililk (a + n + l) 
[F(2) - *(a)] 



[r'(2)-* rfe (a)], MI, 



1 



# z7 2 (a + n + l) 



Z = 1, 



(26) 
n. (27) 



6> i7 2 (a + n + l) 

Thus the information matrix, I y[p(x\j\(&), f° r t ne multivariate Pareto (IV) (0,9, 7, a 
distribution is 



MP(IV)( ) 



I(9t,6 k ) I(9 hlk ) I(9 h a) 
I(9hlk) I(li,lk) I(l/i, at) 
I(0i, a) I(li,ot) 1(a) 



(21 
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3.4 Covariance matrix for multivariate Pareto (IV) 

Since the joint density of any subset of the components of a Pareto (IV) random vector is 
again a multivariate Pareto (IV), Arnold [2], we can calculate the expectation 

— jli \ I — fi k 



E 



Oi J V 



»oo />oo / \rr H / x m k 

x l ~ A*Z \ I x k — 




'0 JO V U l / V U k 

r(q - m;7; - m k j k )T(mm + l)r(m fc7fc + 1) 

r(a) 

m h m k G R, m i7 , m fc7t > -1, a - mm - m fc7fc > 0. (29) 

Evaluating this expectation at (mi = 1, m k = 0), (m/ = 0, m k = 1) and (mi = 1, = 1), 
we obtain 

E[X l ] = f Xi + -^-[r(a- 1 i)r(ji + l)}, 7 ,<a, 7 , > -1, (30) 
r(a) 

E[X fc ] = ^ + -^-[r(a- 7fc )r( 7fc + l)], 7fc <a, 7 *>-l, (31) 
r(a) 

E[x t x k } = n k E[x{\ + mE[x k ] - 

9 9 

+pp:[r(a - 7i - 7*)r(7i + l)r( 7 k + 1)], 71 + 7* < «> (32) 

am 

E [VH = ^h\r(ot - mm)Y(mm + 1)], 7l m, < a, (33) 
T(a) 

4, = f^K [r(a - 2 7 ,)r(2 7 , + l)r(a) - T 2 ( 7 + l)r 2 (a - 7l )] , 2 7 < a, (34) 

r fyvi W( 7f + i)r( 7fc + i) rw 

Cov X,F = — r(«- 7 - 7fc )r(a) 

-r(a- 7fc )r(a- 7 )], 

1 < I < k < n, k = 2,---,n. (35) 
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4 Special Cases 



4.1 Burr(0, 7, a) distribution 

The Burr family of distributions is also sufficiently flexible and enjoy long popularity in the 
actuarial science literature (Daykin, Pentikainen, and Pesonen jjj and Klugman, Panjer, and 
Willmot |14|). However, this family can be treated as a special case of Pareto (IV): Burr 
(0,7, a) = Pareto (IV) (0,9, i, a) (Klugman, Panjer, and Willmot [14J, p. 574). 

Since the Burr distribution is a reparametrization of Pareto (IV) (0,8, 7, a), it follows 
from Lehmann (8), Section 2.7, that its information matrix Jg(O) can be derived from 
Jp^jy-j(O) by J I p[JV) (®) J' ■> w here J is the Jacobian matrix of the transformation of 
variables. Thus, the information matrix of multivariate Burr distribution, I Mb(®) * s then 
given by JI MP ( IV ) (®) J> , wnere 



J 



/ 1 

I7 2 

1 1 



(36) 



which is obtained by noting that J is the Jacobian matrix of the transformation (9, 7, a) 
(04, «)• 



4.2 Pareto (III) (0,0,7) distribution 

This is a special case of Pareto (IV) with a — 1. Therefore, last row and last column of 
/ MP(lv)(®) van ^ sn (t nese represent information about parameter a) and we obtain 



MP(III) 



(6) 



1(0, A) 7(0,, Tfc ) 
I(0,,7fe) Klhlk) 
where we have to substitute a = 1 in all the remaining expressions. 



(37) 
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4.3 Pareto (II) (0,6, a) distribution 

This is a special case of Pareto (IV) with 7 = 1. Therefore I(9i,^f k ), I^u^k) and a ) 
in / Mp (iv) (®) van i sri and we obtain 



MP(II) 



(0) 



i{e h e k ) i(e h a) 

I{e h a) 1(a) 
where we have to substitute 7 = 1 in all the remaining expressions. 



(38) 



5 Conclusion 

In this paper we obtained the exact form of Fisher information and covariance matrix for 
multivariate Pareto (IV) distribution. We showed that all the calculations can be obtained 
from one main moment multi dimensional integral which has been considered and whose 
expression is obtained through some particular change of variables. A short method of 
obtaining some of the expectations as a function of a is used. To confirm the regularity 
of the ln/ n (cc), we showed that the expectations of the score functions are equal to 0. 
Information matrices of multivariate Burr, Pareto (III) and Pareto (II) distributions are 
derived as special cases of multivariate Pareto (IV) distribution. 
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A Expressions of the derivatives 



In this Appendix, we give detailed expressions of all the first and second derivatives of 
ln/ n (x) which are needed for obtaining the expression of the information matrix: 



3=1 yJj 



d\nf n (x) 



da + y ^ \ 6, 

(f) 



Oili V 9 Hi 



1 ( (\ + // 



1 = 1, ■•, n, 



(1) 



(2) 



dhajnjx) 



1 1 /:r A / a + n 



I 7 ' In f B. 

9i / 111 I e t 



1 + 



S7=i (l) 



j = i,. 



d6 k da 



d 2 \nf n {x) 

djkda 



d 2 \nf n (x) 
da 2 



-L) 



-E 



-(a + ^-l) 2 ' 



2_\ ' 



:)" ln fe) 



A; = 1, • • • , n, 



11 l Xj \ 7 



A; = 1, ■ • ■ , n, 



d 2 \nf n (x) 
d9 t 2 



a + n 



1 + 



(?) 



+ 



a + n 

w 



7/ 



1 + 



1 + If 



]_N 2' 



l,---,n, 



(3) 



(4) 



(5) 



(6) 



(7) 
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+ 



a + n 



a + n 



11 In 2 §■ 



\ 



1 + 



/ = !,•••, n, 



(9 2 ln/ n (a;) / a + n 



— — 

xA 11 ( X±\ Ik 

01 \O k 



1 + 



(I) 



j_\ 2' 



d 2 \nf n (x) 



a + n 



g 2 ln/ ra (a;) _ / a + rA 



d-fkdOi 



a + n 



Oat V ft-y? 



a + n 



! + (If) 

^ln(f) 



1 + 



S-i ft)" 



+ 



a + n 



0i 
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B Expression of the main integral 



This Appendix gives one of the main results of this paper which is the derivation of the 
expression of the following integral 



E 



n 

i=i 



Xi\~ 

6; 



n 

i=i 



j-j ' f n (x)dx, 



X 



where, f n (x) is the multivariate Pareto (IV) density function (jSJ). This derivation is done in 
the following steps: 

First consider the following one dimensional integral: 

j_\ — (a+n) 

f 7 * a / ./-| \ / » - / r \ 

Li 



o 6*171 V^i 



Xi \ 



i=i 



Xj \ 1 i 



0, 



a I Xi \ ti 
^7i 



/ 



1 + 



Si 



--i 



-(a+n) 



J=2 



d^i 

-(a+n) 



dxi. 



V 1 

Note that, goings from first line to second line is just a factorizing and rewriting the last term 
of the integral. After many reflections on the links between Pareto (IV) and Burr families 
and Gamma and Beta functions, we found that the following change of variable 



1 + 



XI \ 71 

01 



\ 



1-t' 



< t < 1, 



(2) 



simplifies this integral and guides us to the following result 
aT(ri + l)T(a + n — r\ — 1) 



J'=2 



T(a + n) 

Then we consider the following similar expression: 

a(a + 1) r(ri + l)T(a + n — r*i — 1) /x 2 



-(a+n)+ri+l 



(3) 



C 2 



6*272 



r(a + n) 
14 



6, 



12. 

72 



X 2 \ 72 



3=2 



Xj \ ~<J 



0', 



j_\ — (a+n)+n+l 



/» + 00 

JO 



a(a + 1) r(ri + l)T(a + n — ri — 1) /x 2 



#272 



T(a + n) 



n J-\ —(a+n)+ri+l 



i=3 



1 + 



(f) 



a; 2 \ 72 

02", 

(a+n)+n+l 



V 1 + ^V« 

and again using the following change of variable: 



/ 



(f) 



72 



i=3 \ e 



we obtain: 



C, = 



a{a + l)r(n + l)r(r 2 + l)r(a + n - n - r 2 - 2) 



J'=3 



X,- \ 7 J 



T(a + n) 

j_\ -(a+n)+ri+r 2 +2 



dx 2 , 



(4) 



(5) 



Continuing this method, finally, we obtain the general expression: 



C n = E 



IIU 



i=i 



r(«-Er = in)nr = ir(r, + i) 

r(a) 



J^ri<a, n > -1. (6) 

i=i 



We may note that to simplify the lecture of the paper we did not give all the details of these 
calculations. 
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